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Thn  t  H  I  M  K,  r  of-impl*  •‘n.cture,  high  function,!  density  ,nd  high  .peed. 

leed  r  I  "  e  -P'""'"***-"  “f  hordw.re..  By  the  u.e  of  the.,  circuit  unit,  /high 

speed  fuzzy  logic  microproccor  for  a  real-  time  hardware  expert  .y.tem  ha.  been  designed. 


I.  INTKODUCTION 

put  fo^rrithl »nd  application,  of  fuzzy  ..t  theory  and  Bizzy  logic  .inc.  Zadeh 

^n  rin/e  f  hardware,  ntch  a.  fizzy 

r,r«ter,  0  7;  7T  ->nd  integrated  device,  were  reported  and  derive,  the  beginning  of  fi.azv 

fuzz  hi  ’  '/  I**"  "■'»«»>  *■•<»'?•  (J-»)  designed  and  used  basic  bipolar  or  CMOS  fuzzy  logic  circuit,  to  build  up  their 

eliabl!  hth '7’  "d  b  ”  '"•7*  MOS  IC.  (l,»).  Therefore  simple-  .tructure, 

u7en  ’  i'T  r  '  **  “P"**'*"-  'P-  «'  0)  "port'd  nine 

current-mode  fuzzy  logic  circuit,  in  CMOS  technology.  Her.  w.  proposed  simpler  and  more  reliable  circuit  unit,  implementing 

these  nine  fuzzy  logic  operation.,  a,  well  a.  other  useful  circuit,  of  which  fuzzy  logic  and  multiple-valued  logic  (MVL)  integrated 


II.  NINE  FUZZY  LOGIC  OPERATIONS  AND  THEIR  RELATIONS 
Let  ri7<"  zt’<17d  *"t  "I”**  ”7'''  logic  and  the  relation,  among  the.,  operation,. 

I.  Boid-dlffefeil!.  "•P«‘"e'X- 
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For  the  convenience  of  circuit  realization  of  .om.  of  the  above  fuzzy  logic  operation. 
Operations  are  dedicated  below.  ’ 

(») 

some  necessary  relation,  among  these 
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HI.  CMOS  CUIUIENT-MODE  FUZZY  LOGIO/MVL  CIRCUIT  UNITS 
CMOS  P-  n-ch»nnfl  current  mirrori  in  Fig.  1(»1),  (»i)  »rc  need  to  form  the  circuits  of  the  nhove  nine  bosic  operotion.. 
Fig.  l(bl),  (bJ)  sre  the  simplir.ed  symbols  for  Fig.  I (nl).  (»2),  respectively.  Fig.  J  shows  the  circuits  of  bounded-dilference 
operistion,  where  Fig.  2(nl)  »nd  (s?)  give  two  circuits  with  different  directions  of  output  currents.  Substituting  p-(n-  )rh»nnel 
ciirrent  mirrors  for  n-lp-jchwnnel  ones  in  Fig.  2(ol),  (si)  will  creste  their  complementsry  circuits  shown  in  Fig.  2(bl),  (b2).  This 
circuitry  complementsrity  mesns  s  great  cnnvenienre  for  designers  to  use  these  fuir.y  logic  units  as  toy  bricks  in  their  circuit  system 
without  considering  speciHc  current  directions  between  two  neighbouring  bricks.  All  the  circuit  units  introduced  in  this  paper  are 
of  this  circuitry  comlementarity.  So  the  complementary  one,  of  the  following  circuit  units  are  omitted,  leaving  circuit  rmits  only 
with  their  input  currents  flowing  into  the  units.  With  Er,.  (10-16)  and  the  bounded-difference  circuits  shown  in  Fig.  2  one  can 
easily  obtain  the  corresponding  circuit  units  by  adopting  wired  sum/subt.raction.  Fig.  8-10  show  the  circuits  of  furry  complement, 
union,  intersection,  bounded-sum,  bounded-product,  implication,  absolute  difference,  and  equivalence,  respectively. 

Since  voltage-mode  digital  semiconductor  memories  are  very  mature  and  there  are  currently  difliculties  storing  analog  signals  by 
semiconductor  devices,  conventional  rligital  memories  such  as  SRAM,  PROM  are  prefered  as  peripheral  circuit,  in  furry  hardware 
system,  (1-3).  So  the  grade  of  furrine,,  i,  discretized  in  1  levels  (i.e.  2  bits)  or  8  levels  (i.e.  8  bits)  and  so  on.  This  multiple-hit 
voltage  signal  representing  membership  function  of  a  furry  set  will  be  converted  into  I-bit  current  signal,  say,  0/,A  standing  for 

001),  lOpA  for  001 . and  70pA  for  III .  To  avoid  the  shift  of  transfering  current  through  serially  connected  current  mirrors  a 

current-mode  quantization  circuit  is  needed  which  is  shown  in  Fig.  II.  The  basic  idea  to  design  a  current-mode  register  or  flip-flop 
IS  to  gam  multiple-level  stable  states.  This  can  be  done  by  connecting  the  output  of  a  quantizer  with  its  input,  forming  a  feedback 
loop.  Fig.  12  shows  the  scheme  of  multiple-level  .stable  states.  The  quantizer,  register  and  flip-flop  with  multiple-level  are  also 
vfry  usrful  in  miiltiple-valnf rl  logic. 


IV.  INSULTS  AND  DISCUSSIONS 

The  nine  fuzzy  logic  circuits  contain  only  p-channel  (LrvSpm,  W=30pm)  and/or  n-channel  (I.rrSpm,  Wrr2n,im)  MOS  current 
mirrors.  The  others  include  current  mirrors,  current  sources,  convertors  and  transfer  gates.  The  thickness  of  gate  oaide  and  field 
oxide  are  Iflnm  and  SOOnm,  respectively,  while  the  threshold  voltage,  Vj.p=-1.15v,  VrN=n.77v.  Measurement  result,  show  that  all 
these  circuit  units  can  implement  their  corresponding  fuzzy  logic  operations  well.  Here  as  an  example,  DC  result  of  fuzzy  logic  union 
circuit  is  shown  in  Fig.  18.  The  time  delay  of  this  circuit  is  about  «ns.  Diode  formed  by  connecting  gate  with  drain  of  a  MOSFET 
IS  not  included  in  our  circuits,  since  our  experiments  show  that  a  serially  connected  diode  inside  circuits  has  large  resistance 
and  makes  an  inevitable  voltage  drop,  and  in  turn  influences  the  normal  logic  function  of  the  circuits.  Every  circuit  described 
above  has  two  kinds  of  format,  which  can  be  translated  each  other  by  the  convertion  between  the  p-  and  n-channel  MOSFET. 
Circuit  designers  may  choose  one  of  the  two  form,  of  each  circuit  unit  as  a  building  block  in  their  circuit  system  according  to  the 
current  direction  needed.  There  is  no  need  to  fix  a  current  mirror  between  two  adjacent  circuit  blocks  in  order  to  change  a  current 
direction.  This  will  eliminate  a  time  delay  and  current  shift  stage.  Circuit  units  implementing  bounded-dilference,  fuzzy  logic 
union,  intersection,  quantization,  register,  and  flip-flop  have  been  applied  to  building  up  a  high-speed  fuzzy  logic  microprocessor 
for  a  roal-  time  expert  system  in  the  field  of  robotic  decision-making  (1). 


V.  CONCLUSIONS 

Basic  circuit  units  in  current-mode  are  designed  and  fabricated  in  h  micron  CMO.S  technology.  They  can  implement  variom 
fuzzy  logic  operations  of  bounded-dilference,  complement,  unlon(max),  intersection(min),  bounded-sum,  bounded-product,  impli¬ 
cation,  absolute  dilference,  equivalence.  Also  fabricated  are  current  quantizer,  register  and  flip-flop  which  are  of  importance  in 
building  up  a  fuzzy  information  processing  machine  or  a  multiple-  valued  logic  hardware.  Test  of  chips  show  that  by  use  of  the., 
basic  circuits  one  can  realize  the  corresponding  logical  functions  very  well.  They  exhibit  the  distinctive  features  of  simple  structure, 
Mgh  functional  density,  usage  in  multiple-  valued  logic  integrated  circuits,  and  a  great  convenience  for  high-density  integration. 
These  circuit  units  have  great  potential  to  be  one  of  the  best  circuit  architecture  to  form  fuzzy  logic  and  multiple-valued  logic  very 
large  scale  integrated  (VLSI)  hardwares. 
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Fig. 2  Bo'.irKJeri-differencR  circuit  with  various 
(at)-“(b2)  and  output  current  directions 


Fig. 6  Bounded-sum  circuit 


Fig. 7  Bounded-proBuct  circuit  Fig. 8  Implication  circuit 
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Fig. 9  Absolute-difference  circuit 


Fig. 10  Equivalence  circuit 


lo  tpA) 


Fig. 12  Scheme  of  multiple-level  stable 
states  employing  feedback 


Fig. 13  Input-output  characteristics 
of  union  (max)  circuit 
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ABSTRACT 

Back  propagation  rule  has  been  shown  to  be  an  ef f i c i en 1 1  ear n i ng  algorithm  for  multilayerd 
neural  network.  However»lt  Is  limited  because  It  only  finds  local  minima.  Rol tr.mann 
machine  has  also  been  shown  to  be  an  efficient  learning  rule.  But*lt  Is  limited  because 
it  learning  rate  is  too  stow.  In  thispaper*we  proposed  and  simulayed  a  quantum  learning 
algorithm  for  multilayerd  neural  network. It  Is  shown  that  Its  learning  rate  Is  more  rapid 
than  that  of  Bolt2mann  machine>and  It  can  tind  theglobel  mlnimun  unlike  back  propagation 
a  I gor i thm  does . 

INTRODUCTION 

The  error  backpropagat I  on  rule  would  modify  the  weight  between  neurons  and  j  of  m-th 
layer  and  (in-l)th  1  ayer  #  respec  1 1  ve  I  y  *  as  followst 

AWT  p  6  TO"'*,  <  n 


where  p  is  an  acceleration  constant  that 
output  of  k'  th  neuron  is  q,,*  i  ts  input  is 
for  final  layer#  n#  by 


relates  to  the  steps! ze  of  the  simulation.  The 
pk#  and  6k  is  the  backpr opaga t i on  error  given 


6  T=r"(P*;)(ui-t,) 


(2) 


and  for  all  other  layers  by 

6  T  =  f"(P7>I^6  r’ WTt*  ^3) 


The  error  backpropagat i on  rule  has  been  shown  to  be  an  efficient  learning  algorithm  for 
multilayerd  neural  net  work. However# It  Is  limited  for  It  only  finds  local  mini mas.l.  earning 
in  a  Boltzmann  machine  has  two  phases.  In  the  training  phase  a  binary  input  pattern  is 
imposed  as  well  as  the  oorrect  binary  out  put  pattern  on  the  out  put  group  .The  system  Is 
a  I  I  owed  to  relax  to  equilibrum  at  ft  xed  ■temperature*  while  the  Inputs  and  outputs  are 
held  fixed.  In  equilibrium#  the  average  fraction  of  the  time  a  pair  of  units  is  on  toge¬ 
ther#  I.e.  the  co-occurrence  probability  plj#  is  computed  for  each  connection.  In  the  test 
phsae  the  same  procedure  Is  f or -co-occur rence  probabilities#  plj#  are  again  computed. The 
weights  are  then  updated  according  tOt 

AW,  e  (PT  j-PY  j)  (4) 

where  e  controls  the  rate  of  learning. 

Similarly#  Boltzmann  machine  has  also  been  shown  to  be  an  efficient  lenrnlhg  rule  for 
multilayerd  neural  network.  But»lt  is  limited  for  Its  rate  of  learning  is  too  slow. 

In  this  paper#  according  to  ITO  stochastic  differential  equationt 

^-Vf  (  4  )dt+  f  dw  (5) 
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where  vf  is  the  gradient  of  f  and  w(t)  is  a  standard  n-d I  mens i ona I  Wiener  process*  where 
Is  a  constant*  we  proposed  and  simulated  a  quantum  learning  algorithm  for  multl- 
layerd  neural  netweek  which  can  find  global  minimum  and  coverge  rapidly. 

A  ODANTUM  LEARNING  ALGORITHM 
Consider  equation  as  followst 

d5  V  f  <  S  )dlT  O  t)dw  (fi) 

6  <0)«xo  .  (7)  . 

Without  the  loss  of  generality*  we  assume  that 

1  t  W  f  (x )  ^ 

//  X  //  *  —  C=) 

I  j^^expf  -  fl  ®F  (X)  I0X<  CO  »  \7  n  f^R\f01 

f  t  R"  -  R 


lo  integrate  numerocally  equations  (6)  and  (7.1*  let  us  look  at  the  asymptotic  value  of  a 
sampled  numerical  trajectory  solution  to  obtain  a  global  mintmium  off.  Plrstly*  consider 
equations  (6)  and(7)*  when  (:  =  f  o  Is  a  constant. 


d  ^  «  V  f  (  4  '<Jtt  ^  odw(  t  >  (g) 

Let4  stoohastio  process  solution  of  (U)  and  <7)i  lor  any  Borel  set  ACK”* 

define 

P(:^(0*xo.l.A)>=P(4  <n> 

where  P(  •  )  is  the  probability  of  I  •  )  and  Pf  „(0.  xo»  t*  A)  Is  tlietrans  I  1 1  on  probability 
of  4  f„(t). Under  regularity  assump t I ons f or  f*  we  have 

P f  ^(0* Xo> t» A>=  I  f  ^( 0* xo* t * x)dx  110) 

where  the  IranslUcn  probability  density  pap^^(0*  xo^t^  x)  SHllflSs  the  following  Fokker 
-P  I  nnnk  equa  1 1  on 

g  p/3  t=  (  (:  o/2  )  A  pfdi  v(  V  fp)  (11) 

with 


1  in  P£  (0*  xo»  t *  X )  6  < x-x©) 

l~-*>  oo  ^  ^ 


(  12) 


where  A  and  div  are  the  Laplaolan  and  the  divergence  with  respect  to  x»  and  6  (  •  )  Is 
the  Dirac  delta  function. Let  A^^  be  defined  by 

l/Ap  1  ^„expC-2f(x)/6  (13) 

then  as  t-“oe,the  trandltlon  probability  density  p ^  ^(0> xo> ti xiapproaches  to  the  function 

P  (  <0.xo.x)-A^^expC-2t(x)/6o]  (H) 
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Cleurly,  p  g  Is  the  probability  denalty  of  a  random  variable  I  ^  ^ 

so  that  i  €0*“**^  fo  '*"®  “>  •«'*  Let  us  remark  that  p. 

does  not  depend  on  the  Initial  condition  xo. 

From  the  reasoning  above,  we  can  obtain  that,  as  €  o-O.  the  the  asymptotic  probability 
density  approaohes  to  a  Dirac  delta  f.netlon  concentrated  on  the  global  minimum  or  a  line 
ar  combination  of  dlrac  delta  functions  concentrated  on  the  global  the  golbal  minima. The 
linear  combination  depends  on  the  curvatures  of  f  at  the  global  minima. 

We  can  also  obtaain  that#  when 


and  following  equation  is  sptisfied* 


I  ^  exp(-C2/(:  "  <  t )  3A  f  + )  dt»oo 


(16) 


where  Af.  Is  the  highest  barrier  to  the  global  minima,  we  can  find  the  global  minima  of 
fix)  according  (8).  From  (16).  we  know  that  fit)  most  go  to  zero  slowly. 

From  above,  the  (B)  can  be  easily  used  to  train  multilayered  neural  network.  Let 

f'EnSlO.-t.)’ 

I 


where  o.  Is  actu.l  output  of  l-th  neuron  of  network. t.  Is  the  desired  output  of  i-th  neu 
ron  of  networks  And  let 


A  Ik  >0.  tv  -  A  I , (lo  =  0) , k=0y  I , — 

i  =0 

we  can  discretize  (8)  using  the  Euler-Cauchy  method,  that  Is,  6  (t)  Is  appioximated  by  the 
£u  solution  of  the  following  finite  difference  eqnntlons. 

4  la  +  I  ■'  4la“~AtKVr(6K)  +  €  <tK>  (WK  +  |~WK>Fk  =  0.  K 
^  o=Vo 

In  the  (11),  ,.,.p  and  substitute  for  U.Atg  and  wa,  we  can  obtain  the  general  to. « 
of  qiiAntnm  Irtnrnlng  riil#i  an  follows 

w,  j(kkl)-Wt  j(k)--p  V  f(W,  j(k)>  +  (  (Mk  +  i-Mk)  k-Ohl,-,  (Ifl) 

.SIMULATION  RESULT 

We  u.se  a  tb.ee-laye.  neural  network  and  train  It  to  function  shift  register.  The  tialning 
rules  we  have  used  are  er  ror  hackpropaga  t  Ion .  Roitv.maan  machine  and  O.iantum  learning  ones, 
the  simulation  result  Is  shown  In  FIC.l.  Clearly,  from  FIG. I,  the  rate  of  learning  of 
Ouantum  rule  la  much  more  rapid  than  that  of  Doltzmann  machine.  The  Quantum  rule  can  find 
the  global  minima  as  proven  ahove.  Ouantum  learning  algorithm  has  ho«n*used  to  train  mul- 
tllayered  neural  netword  to  recognize  ship  silhouettes. 


<  17) 
(  18  ) 


7 


REFERENCE 


1.  R«melh.'irt»D.E.«l  'Parallel  dletrlbuted  Prooecclng'>  The  MIT  Presc»  Cambr  I  dge .  !  986 

2.  Se.lnowskI#!, J.,  'Nenrnl  Network  LearnInR  Algorithms'  I n  NATO  ASI  Series  Vol.F41,  'Neu 
rnl  Compiilers'  fed.  by  Eckmlller  and  Malshurg)  Spr I nger-Ver 1 ag  Berlin  Heidelberg  1988,  pp 
291-800. 

3.  MntkowskI, B. J.  and  Schuss,  Z. ,  'Eigenvalues  of  the  Fokker-Plank  Operator  and  the  Appr 
och  to  Equilibrium  for  Diffusions  in  Potential  Field',  SIAM  Journal  on  Applied  Mathematic 
s.VoMO,  1981.  pp. 242-254. 

4.  Ange I e 1 1 1  *  A* Castagnar I  * C.  and  Zir 1 1  I  I , F>, 'asymptot lo  Eigenvalue  Degenerrancy  for  a  cl 
ass  of  One-Dimens  legal  Fokker-Plank  Operators'  Journal  of  Mathematical  Phys i cs Vo  1 . 26 ,  19 
85,  pp. 878-890. 

5^  'Global  Optimization  and  Stochastic  D I f f er en 1 1 ca  I  Equations', 
Journal  of  Optimization  Thiory  and  Applications,  Vol.47,  No.l,  Sept.  1985,  pp.|-ie. 


FIG.I.  Simulation  Res  ii  Its 


HIE  IRUIH- VALUED  FLOW  INFERENCE  NETWORK 

Wang  Pci  Zhuang*.  Wu  Zhi  Qiao*  and  Tel.  Hoon  Heng 
Institute  of  Systems  Science,  National  University  of  Singapore 
Heng  Mui  Keng  Terrace,  Kent  Ridge 
Singapore  0511 

*  Visiting  Scientists  from  Beijing  Normal  University,  Beijing,  P.R.China 


•  A  avTiv-’  I 


T„e  conve„,i„„a,  fuazy 

oniposu.ona  rule  of  inference  method.  But  there  is  a  limitation  for  the  fuzzy 
rzlaion  ,epr„a„,  o„„,p„c..ed  cpn.rpl  n,le,  Ip  f„J 

»m™i  A  rpzzp 

.l.c,na.,.P  „„„a|p  T™.h-„,„Pd  Flow  ,„ra„«oc  me, hod.  B,  ,hl.  . 

P.opoa,„„„  ,a  ,e,a,dad  as  a  oHanoe,  along  which  ihe  ,™,ha  c.n  „ow  and  ihc 
zzy  in  enneo  „  realized  as  snch  a  process  Ural  ihe  irnlh  valnes  flow  along  an 
m  eionce  channel  from  ,he  .op(preeedenee)  to  lire  end(amecedence).  The  Irnlh 
.aiie  I„a,  decrease  when  flowing  along  the  channel  becaose  there  exist, 
;«ce  in  the  channel.  In  this  paper  we  ntahe  nse  of  the  concept  of  nenral  i;:: 

,,  ...  interence  to  a  nenral  network  form.  B,  Ihe  TVFIN  It  I, 

^1  le  to  represent  knowledge  and  control  rnles  In  fnzzy  control  and  carry  on 
the  fuzzy  inference  effectively.  ^ 

keywords:  Approalinate  Reasoning,  Fozr.y  Infereiiee,  Fnzzy  relation,  Fnzzy 
Control,  Neural  Network. 


1.  INTRODUCTION 

After  the  fnzzy  sets  theory  coming  into  the  logiclHKIS),  the  reasoning  is  no 
ye,  only  trne  or  false,  yes  or  no  as  It  is  in  the  conyentlon.l  logic  Fnzzy 

drZ!"  “  "  "" 

The  pattern  of  fuzzy  inference  is 


P—^ 

_ £1 

Q' 


(1) 
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The  concept  of  fuzzy  inference  is  as  the  following: 

Assume  that  P(x){xsX)  sind  Q(y)(yEY)  are  two  fuzzy  linguistic  proposition  in 

the  universe  of  discourses  X  and  Y  respectively,  when  given  implication  P - 

and  a  precedence  P'  which  is  approximately  near  to  P,  what  Q'  is  to  be  deducted 
from  the  implication  P — ? 

In  1973,  L.  A.  Zadch[15J  used  the  fuzzy  relation  to  model  the  fuzzy  linguistic 
implication,  carrying  out  a  method  of  fuzzy  inference  namely  the  Compositional 
Rule  of  Inference(CRl)  in  which  the  fuzzy  inference  is  the  compositional 
calculation  of  the  fuzzy  relation. 

In  CRI  method,  the  implication  P - >Q  is  described  as  a  fuzzy  relation  from  X  to 

K,  denoted  by  /?.  The  CRI  method  is  a  fuzzy  transformation  as  follows, 

C'  ^  P'oR  (2) 

GYy;  ^(P^oR)(y)  (3) 

There  have  been  many  literatures  discussing  the  definition  of  fuzzy  relation 
R  which  express  the  fuzzy  implication,  more  then  50  different  definition  of  R  and 
their  compositional  rules  are  available.  The  most  worthwhile  works  in  this  area 
are  made  by  Gaines  R.  R.[21,  Handler  J.  F.[1J,  Kandel  A.  and  Cao  Z.  [6]  ajid  Mizumoto 
M.  and  Zimmerniann  H.  J.  [8],  e.c.t. 

In  the  fuzzy  implication  P - X2 .  when  the  antecedence  Q  is  directly  related  to 

the  precedence  P,  the  fuzzy  relation  R  can  model  the  fuzzy  implication  effectively. 
For  example,  the  simple  fuzzy  implication 


if  A  then  B  (4) 

or  if  A  and  B  the  C  (5) 

can  be  modelled  by  fuzzy  relation  R. 

For  (4)  R  -  A  XB  (6) 

For  (5)  R  =  A  X  B  X  C  (7) 


However,  in  the  opinion  of  authors  of  [12]  and  [13],  the  fuzzy  implication  is 
the  expression  of  the  human  knowledge,  some  times  it  is  very  complicated.  The 
antecedence  may  not  be  directly  related  to  the  precedence,  there  may  be  many 
branches  which  cross  each  other.  That  is  to  say,  the  framework  of  knowledge  is  a 
complicated  network.  In  this  case,  the  fuzzy  relation  R  can  not  represent  the 
knowledge  effectively.  Moreover,  for  every  branch  of  implications  there  should 
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be  a  cerlainty  degree  which  may  be  dynamic  other  than  static.  The  fuzzy  relation 
theory  also  cannot  deal  with  the  dynamic  process. 

To  create  a  new  way  of  fuzzy  inference  to  overcome  the  limitation  of  fuzzy 
relation  method,  the  authors  of  [12]  and  [13]  proposed  a  different  method  of  fuzzy 
inference  namely  Truth-Valued  Flow  Inference  method.  In  the  truth-valued  flow 
inference,  a  proposition  or  fuzzy  implication  is  regarded  as  a  channel  along  which 

the  truth  value  can  flow,  and  the  fuzzy  inference  is  viewed  as  such  a  process  that 

the  truth  values  flow  along  an  inference  channel  from  the  top(precedence)  to  the 

end(antecedence).  The  truth  value  may  decrease  when  flowing  along  the  channel 
because  there  exists  resistance  in  the  channel. 

According  to  the  truth-valued  flow  inference  method,  for  the  implication 

^  *Q<  tbe  truth  value  of  (2  is  a  function  of  the  truth  value  of  P  ,  i.e. 

T(Q)  =  f(T(P))  (8) 

where  T(Q)  is  the  truth  value  of  Q  . 

Here  the  head  of  the  inference  channel  is  P  ,  the  terminal  of  it  is  jQ  .  The 

function  f(x)  expresses  the  certainty  degree  of  the  proposition.  If  the  f(x)  is  given 

by  a  differential  equation,  the  fuzzy  inference  can  be  treated  as  a  dynamic  process. 

The  procedures  of  fuzzy  inference  are  as  follows  according  to  the  truth¬ 
valued  flow  inference  method: 

1)  Build  up  a  channel  set  base  which  comprises  a  limited  number  of 

channels:  Pj  ^Qi  (i=I,  2,  ....  n),  which  represent  the  knowledge. 

2)  The  given  information  is  to  form  a  fact  P'l  which  is  a  fuzzy  set  on  the 
universe  of  discourses  X.  The  truth  value  of  P,'  is  its  nearness  to  P/  . 

)  =  near(Pi ,  Pj).  l(Pi')  will  be  the  input  to  the  channel  and  the  output 
of  the  channel  will  be  calculated  by  (8). 

3)  The  output  of  the  channels  is  to  be  processed  to  do  the  decision  making. 

The  above  is  called  three  steps  of  inference.  The  important  thing  of  this 
method  is  that  the  output  of  one  channel  can  be  the  input  of  the  other,  the 

channels  can  link  each  other  and  hence  forming  an  inference  network  among 
which  there  may  be  many  media  relay  stations  of  truth  value  transformation.  By 

this  way,  the  complex  knowledge  or  control  rules  in  fuzzy  controller  can  be 

represented  effectively. 

Actually  the  truth-valued  flow  inference  method  has  suggested  a  framework 
of  inference  network  which  is  something  like  the  neural  network.  So  the  authors 
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in  this  paper  make  use  of  the  eoncept  of  the  neural  network  to  convert  the  truth- 
valued  flow  inference  into  a  neural  network  form  to  construct  a  Truth-Valued 
Flow  Nctwork(TVFlN). 

Various  neural  network  models  have  been  proposed  and  studied  by  many 
researchers.  These  models  such  as  Crossbar  Associative  Network[10J,  Adaptive 
SystemtSJ,  Boltzmann  Machincsl4],  Self-organization  and  Associative  Memory[ll] 
and  Neocognitrins[7]  are  powerful  tools  for  the  study  of  pattern  processing. 
However,  to  model  human  knowledge,  besides  pattern  processing  capability,  the 
logical  reasoning  capability  is  equally  important.  Another  new  neural  network 
called  Neural-logic  Network  which  is  able  to  do  the  logical  reasoning  is  proposed 
by  Prof.  Ich  H.  H.  et  al.[5]  Because  the  fuzzy  inference  is  a  fuzzy  logical  reasoning, 
we  utilize  the  Neural-logic  Network  structure  in  TVFIN. 

2.  THE  TRUTH-VALUED  FLOW  INFERENCE  NETWORK 
The  TVFIN  is  defined  as  a  multi-layer  network  consisting  of  a  set  of  nodes 
represented  by  small  circles  drawn  on  a  plane  and  a  set  of  directed  arcs  linking 
some  related  pairs  of  nodes.  Each  node  stand  for  a  fuzzy  subset  of  a  linguistic 
variable.  Every  link  is  attached  with  an  ordered  pair  of  real  numbers  as  its 
weightage.  The  nodes  stand  for  the  input  linguistic  variables  are  called  input 
nodes,  those  that  stand  for  the  output  variables  are  called  output  nodes  and  the  rest 
are  called  the  hidden  nodes  which  stand  for  the  median  variables.  An  example  of 
ihe  TVFIN  is  shown  in  Fig.  1. 

hidden 


Fig.  1  The  structure  of  the  TVFIN 

Each  node  can  be  assigned  an  real  number  fi  e  [0,1  J,  which  represents  the 
truth  value(membership  degree)  of  a  fuzzy  linguistic  variable.  Both  real  numbers 
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of  the  ordered  pair  for  the  weightage  of  each  link  is  between  [-1,  1].  The  network 
is  activated  by  assigning  a  truth  value  in  [0,1]  to  the  input  nodes.  The  fuzzy 
inference  is  such  a  process  that  the  truth  values  flow  from  the  input  nodes  to  the 
output  nodes  according  to  the  rule  of  propagation.  The  propagation  rule  is  defined 
as  follows: 

Let  P  be  a  given  node  of  the  network.  Let  P ; ,  P2 . .  be  all  possible  nodes 

which  have  links  to  the  nodes  P.  Truth  values  associated  with  the  node  Pi  is  denoted 
by  fii  and  that  associated  with  P  by  po*  the  weightage  for  the  link  connecting 

Pi  to  P  is  denoted  by  fa/,  bi),  a/,  fc/  e  [-1,  7/.  The  network  is  shown  in  Fig.  2. 

PI 
P2 

Pn-1 
Pn 

Fig.  2  The  rule  of  propagation  of  TVFIN 

The  the  truth  value  of  output  P,  is  calculated  by  the  following  formula: 

n  n 

Ma  =  /  -  l^(Pi*bi)l  /  (9) 

1=7  1=7 

It  is  required  that  all  c2i(or  bi)  of  links  to  a  node  be  of  the  same  signfa/  and  bj 
may  not  be  of  the  same  sign),  this  is  for  the  convenience  of  modelling  the  fuzzy 
control  rules  in  fuzzy  controllers. 

In  the  example  of  Fig.  3,  the  left  side  can  be  simplified  as  the  right  side.  Where 

=  aj*la-bl,  b*i  =  bj^ja^bj 
a*2  =  ^2*l^-bh  b*2  =  b2^la-bl 

Pi 
P2 

Fig.  3 
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In  fuzzy  logic  the  union,  the  intersection  and  the  negation  are  the  basic 
operations.  Let’s  see  how  these  operations  are  modeled  by  the  TVFIN. 

1).  The  union  operation.  Fig.4) 


Fig.  4  The  union  operation 

2).  The  intersection  operation.  (see  Fig.  5) 


Fig.  5  The  intersection  operation 
3).  The  negation  operation.  /io  =  /-Ai7.(sce  Fig.  6) 


Fig.  6  The  negation  operation 
3.  THE  TVFIN  IN  FUZZY  CONTROL 

Fuzzy  controller  is  proposed  as  an  alternative  to  the  conventional  or  modern 
control  methods  when  a  system  to  be  controlled  is  mathematically  ill-understood  or 
intractable.  Modern  control  theory  always  relies  on  the  precise  mathematical 
model  of  a  controlled  system.  Fuzzy  controller  simply  imitate  the  control  strategy 
of  a  human  operator  and  it  is  unnecessary  to  know  the  mathematical  model. 
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In  a  manual  control  system,  human  operator's  strategy  to  control  the  process 
can  be  expressed  in  a  set  of  control  rules,  for  example, 

if  ERROR  is  PL  and  CHANGE  IN  ERROR  is  NM  then  CONTROL  is  PL 
and  eel. 

Where  ERROR,  CHANGE  IN  ERROR  are  linguistic  variables  of  input  and 
CONTROL  is  that  of  output,  they  are  defined  as 


ERROR=(PL.  PM,  PS,  ZO,  NS,  NM,  NL} 

CHANGE  IN  ERR0R={PL,  PM,  PS,  ZO,  NS,  NM,  NL} 
CONTROL={PL,  PM,  PS,  ZO,  NS,  NM,  NL} 


(H) 


where  PL,  PM,  PS,  ZO,  NS,  NM,  NL  are  fuzzy  subsets,  meaning  positive  iarge,  positive 
medium,  positive  smaii,  zero,  negative  smaii,  negative  medium  and  negative  iarge 
respectively. 

Generally,  assume  that  there  are  two  inputs  linguistic  variables  A  and  B,  and 
one  single  output  linguistic  variables  C,  with  their  universes  of  discourse  being  X  , 
Y  and  U  respectively. 


A  =  {A0  B7(X),(ie  I) 

B  =  {Bj}  e  T(Y),  (JeJ) 
C={Ck}  eT(U),(keK) 


(12) 

(13) 

(14) 


where  /=/■/,  2,  •••,  m},  J=(I,2,  n},  K=-{1,  2,  -,  h},  9(X)  represents  the  fuzzy  power  set 

of  X. 

The  human  operator's  control  strategy  is  usually  described  in  terms  of  a  set  of 
multi-complexed  linguistic  implications  as  follows: 

If  A  is  Ai  and  B  is  Bi  then  C  is  C^ 

(15) 

(i  e  I,  J  €  J,k=  (p(i,  J)  e  K  ) 

Usually,  the  fuzzy  relation  theory  and  compositional  rule  of  inference 
method(CRI  method)  is  adopted  to  design  fuzzy  controllers  since  Mamdani  and 
Assilian  constructed  the  first  fuzzy  controller  in  1974[9]. 

When  using  the  fuzzy  relation  theory  and  compositional  rule  of  inference 
method  the  above  fuzzy  implications  can  be  translated  into  a  three-dimensional 
fuzzy  relation  R  as  follows: 

R  (Ai  X  Bj  X  Ck) 
i.j 
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(16) 


Re  !f(X  xYx  U), 

R(x,  y,u)  =  v  <Ai(x)  A  Bj(y)  a  Ck(u)). 
ij 

ik  =  <p(i,  j)  e  K  ) 


where  R(x,  y,  u),  Ai(x),  Bj(y)  and  Ck(u)  are  the  membership  functions  of  R,  Ai,  Bj 
and  Cic  respectively.  The  fuzzy  controller  is  shown  in  Fig.  7. 


A*(x) 

Ai(x)  _ 

X  ^ 

B*(y) 

Y 


a(u) 

u 


■►C*(u) 


Fig. 7  Fuzzy  relation  in  fuzzy  controller 


Suppose  that  the  inputs  of  the  fuzzy  controller  at  a  certain  instance  are  fuzzy 
sets  A*  e  y'(X),  B*  e  9(Y),  according  to  the  CRI  method,  the  output  of  the  controller 
will  be  tire  fuzzy  set  C*  e  9(U),  i.e 


C*  =  (A*  X  B*)  oR 

C*iu)  =  sup  (A*(x)  A  B*(y)  a  R(x,  y,  u)) 
xeX 

yeY 

=  sup  ((A*(x)  A  B*(y))  A  (V  (Ai(x)  a  Bj(y)  a  C^(i,  j)(u)))) 
xeX  iJ 

yeY 

=  sup(  V  ((A*(x)  A  Ai(x))  A  (B*(y)  a  Bj(y))  a  Cg,(i,  j)(u))) 
xeX  i,j 

y€Y 

=  V  sup((A*(x)  A  Ai(x))  A  sup(B*(y)  a  Bj(y))  a  C,p(i^  j)(u)  (17) 

iJxeX  yeY 


In  actual  applications  the  inputs  of  the  controller(i.e  observed  values  of  the 

controlled  process)  are  some  definite  real  numbers.  Suppose  in  a  certain  instance 
the  observed  value  is  a  pair  (Xg,  y^),  then  the  fuzzy  sets  of  inputs  A*  and  B*  are  as 

follows, 


1 ,  X=Xo 

0.  ...o  ’  =  t 


1.  y=yo 

0,  yityo 


(18) 
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(19) 


so  that 


therefore 


or 


5Up(A*(x)  A  Ai(x))  =  Ai(Xo) 
xeX 

sup(B*(y)  A  Bj(y))  =  Bj(yJ 
yeV 


C*(u)  =  V  (Ai(Xo)  A  Bj(yJ)  A  C(p(i^  J)(u) 

ij 

(i  E  IJ  e  /,  <p(ij)  E  K) 

C*(u)  =  V  r  V  (Ai(xJ  A  Bj(yJ)  a  Ck(u)) 
kEK  <p(i,  j)=k 

(i  E  IJe  J,  <p(ij)  e  K) 


(20) 


(21) 


(22) 


Using  the  defuzzification  method  of  Ccnler-C-Gravity,  the  actual  output  of  the 
fuzzy  controller  is, 


Uo  =  I  (  v(Ai(Xo)  A  Bj(yo))}  #  Uk 

kEK  <p(i,  j)=^k  (23) 

(i  E  IJ  E  J,  k=<p(ij)  E  K) 

where  the  uk  is  the  gravity  center  of  (Ai(Xo)  a  Bj(yJ  a  Cjt). 

We  can  see  that  ,  the  above  method  of  fuzzy  inference  in  fuzzy  controller  is 
very  simple  and  easy  to  understand.  This  is  the  reason  that  it  is  widely  used  in 
practice. 

Lefs  examine  the  control  rules  in  equ.  (5),  there  is  not  any  median  linguistic 
variables  between  the  inputs  and  the  output  variables.  But  in  many  complicated 
industrial  processes,  when  describing  the  human  control  strategy,  some  median 
variables  may  be  required.  For  example,  a  process  concludes  several  different 
sections  each  of  which  is  operated  by  different  person,  when  describing  the 
control  strategy  of  the  system  each  person  can  only  note  down  the  behavior  of 
each  section  and  he  does  not  know  the  relation  between  the  inputs  and  outputs  of 
the  whole  system.  So  we  need  some  median  variables.  In  such. cases,  how  to 
translate  the  control  rules  into  a  fuzzy  relation  R  becomes  a  difficult  problem. 
Even  if  the  R  is  available,  it  is  still  too  complicated  to  calculate  the  composition  of 
the  fuzzy  inference. 

For  instance,  consider  a  set  of  rules  as  follows 
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if  A-Aj  and  8=83  then  C-C2  and  D=Di 
if  A=A2  and  8=8]  then  D=D2  and  E=E2 
ifA=A3  then  C=Cj  and  E=Ei 

if  8=82  and  C=C]  then  D=D2  (24) 

ifC=C2  and  D=D]  then  E=E] 
ifC=C]  andD=D]  then  E=E2 
ifD=D2  then  E=E3 

where  A={Ai,A2,  A3}.  8={8i.  82,  83}.  C={C}.  C2},  D=[D].  D2}  and  E={E].  E2.  E3}.  A 

and  8  are  lire  linguistic  variables  of  the  inputs.  C  and  D  are  that  of  the  median 
variable  and  E  is  that  of  llic  output. 

It  is  really  a  mess  when  looking  at  such  a  set  of  fuzzy  rules.  It  could  not  be 
translate  into  a  fuzzy  relation  R  with  easy.  When  the  number  of  the  fuzzy  subsets 
of  each  variable  and  the  number  of  the  linguistic  variables  increa.se.  obviously  the 
difficulty  goes  to  extreme. 

It  is  obvious  that  the  operator's  description  of  the  system's  behavior  may  not 
always  reflect  the  actual  situation  exactly  by  100%.  When  a  set  of  control  rules  is 
given,  someone  may  ask  such  a  question  as;  how  much  is  each  rule  true  or  how 
much  do  you  believe  it?  We  will  attach  a  number  of  percentage  to  each  individual 
control  rule.  For  example,  if  A  then  8(0.8).  where  the  number  0.8  is  the  reliability 
factor  of  the  rule  "if  A  then  8".  In  this  case,  the  fuzzy  relation  theory  is  unable  to 
model  the  fuzzy  control  ruICvS. 

To  tackle  the  problems  mentioned  above,  using  TVFIN  will  be  much  more 
flexible  and  convenient  than  using  the  fuzzy  relation  R. 

First,  let's  see  how  the  TVFIN  model  the  following  inference  sentences  in  the 
fuzzy  control  rules: 

1) .  if  A  then  8(w).{$ec  Fig.  8) 

A  B 

Fig.8 

2) .  if  A  then  8  and  C(>v).(see  Fig.  9) 
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Fig.  12 

Where  the  weight  W  is  the  certainty  factor  which  represents  the  reliability  of 
the  rules. 
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Therefore,  according  to  the  definition  of  the  TVFIN  the  fuzzy  control  rules  in 
equ.  (5)  can  be  translated  into  a  TVFIN  as  shown  in  Fig.  13.  In  Fig.  13,  W ijk  is  the 
weightage  associated  with  the  link  connecting  node  (Ai  a  Bj)  and  C^. 

Wijk  =  I,  when  (p(i,  j)=k;  Wijk  =  0,  when  (p(i,  j)*k. 


Al 


Am 


U\ 


Bn 


Fig.  13  The  TVFIN  of  rules  in  (15) 


If  the  input  nodes  are  placed  truth  values,  according  to  the  rule  of 
propagation,  the  truth  values  of  the  output  nodes  are: 


Ck(Uc)  =  v(Ai(Xo)  A  Bj(yo))  *  Wijk 

-  v'  (Ai(Xo)  A  Bj(yJ) 

(p(i,  J)=k 


(25) 


(i  e  l,j  e  J,  k  e  K) 

where  Ai(Xo)  and  Bj(yo)  are  the  truth  values  of  the  inputs  and  Ck(Uo)  is  that 
of  the  outputs  as  shown  in  Fig.  14.  We  make  a  weightage  sum  of  Cki^o)  as  the 


defuzzified  output  of  the  fuzzy  controllcr(  see  Fig.  14). 


C(uJ  »  W'k 
keK 

=  I(v(Ai{Xo)  A  Bjiy^m  ♦  W'k 
keK  ip(i,  J)=k 
(i  e  l.j  e  J,  k=<p(i,J)  e  K) 
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If  wc  choose  W'k  =  Uk.  the  result  of  equ.  (18)  will  be  the  same  as  that  of  equ. 

(13).  This  shows  that  the  conventional  inference  method  of  fuzzy  controller  is  a 
special  case  of  the  TVFIN. 


Fig.  14  The  input  and  output  of  the  TVFIN. 

With  the  TVFIN,  the  set  of  fuzzy  control  rules  in  equ.  (14)  can  modelled  as 
Figure  15.  If  the  truth  values  of  the  input  nodes  are  given,  the  truth  values  of  the 
output  nodes  can  be  calculated  according  to  the  rule  of  propagation  of  the  TVFIN. 
The  TVFIN  overcomes  the  difficulty  of  the  fuzzy  relation  which  is  hard  to  model 
fuzzy  control  rules  like  equ.  (14).  This  means  that  the  TVFIN  can  model  control 
rules  of  any  complication  and  any  number  of  variables.  This  feature  is  especially 
useful  in  the  knowledge  representing  in  expert  systems.  It  is  very  convenient  to 
increase  variables  and/or  rules,  which  is  done  by  just  adding  some  nodes  and  links 

to  the  old  TVFIN.  It  is  benefit  when  an  expert  system  has  to  be  renewed  with  new 
knowledge. 
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Fig.  15  The  TVFIN  of  rules  in  equ.  (24) 
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ABSTRACT 

In  tijis  paper,  we  proposed  and  simulated  a  practical  approaclj  to  recognize  ship 
silhouettes  independently  of  translation,  scale  changes,  rotation  and  any  aspect 
angles  using  neural  net  The  proposed  neural  network  system  consists  of  two 
subsystems.  One  is  moment  invariant  subsystem  and  the  another  is  a  multilayered 
neural  network  t  li  a  t  is  tranined  using  quantum  learning  algorithm  Tlie  si  nr  u  la  ted 
results  show  that  thi.s  system  can  recognize  ship  silhouettes  very  correctly 

INTRODUCTION 

For  recognizing  ship  silhouettes, required  the  ability  to  identify  a  specific  ship 
as  translates,changes  scale  or  aspect  angle.  Many  authers  have  studied  tliis  problem 
f  l,3,l,.S,bJ  ,hut,all  of  approches  they  proposed  are  impractical  for  pattern 
recognition. A  neural  network  can  be  trained  to  do  this  .However  ,it  required  a  very 
large  number  of  training  samples  and  the  long  training  time. So, this  method  is 
impractical  too.  In  this  paper.  We  construct  a  system  as  shown  in  FIO.l.This  .‘jysten 
ran  do  this  very  well. The  system  consists  of  two  subsystems, using  moment  invariants 
to  perform  preproceis sing, and  then, using  multilayered  neural  network  to  perform  ship 
siliiouetles  recognition, and  to  discriminate  two  somilar  looking  siiip  silhouettes. 

In  FIG. 1, the  moment  invariants  are  used  to  provide  tran.slation,scai/*  change  and 
lotation  invarivnce,a  small  multilayer  d  neural  network  arc  used  to  provitic  aspect 
angle  change  invariance  and  give  outputs  of  ship  silhouettes  recognition  after  the 
pr  eproces.iin  g  which  is  performed  by  moment  invariants. 


THE  MOMENT  INVARIANT^^ 


Given  a  two-dimensional  image  d  e n  .s i  t  y  <1  i s  t  r  i  b  u  t  i o n  f  (  \  ,y  )  .the  d  i  s c  r  i  p t  o  r  t 
used  in  [2]  are  functions  of  the  moment  tleftiied  by 

Mp.,  -  U  i;  x'  y'*  f  (  X,  y  )  p.  q  =  0>  I  /  •  •  (  1  > 

tire  central  moments  that  have  the  property  on  translation  invariance  are  given  l)y 

'I'p  -1  --  1]  C  X  -  X  ) "  <  y  -  y  ) '"  f  (  X ,  y  )  (  2  ) 


in  10 

where  X  “  , 

Y  ^ 
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ffloo 

T  li  e  following 

ftinclioiis  R(l)# 

R(  2 ), 

R(  3  ) 

R(  4 ).  R( 5  R( 6  ),  R( 7  ),  n  re 
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invariant 

n  n  H  ^  r 

translation  a.  ri  d 

rotation 
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10?)'  1  1  T  ^  1 
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■  (  1  1  n 

3I1?)'  1  (3T21 
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R(  1 ) 

“  (  T  3  0 

1  T  1 2  1-  (  3  ?  1  3- 

T  0  3 )  ^ 

R(  5 ) 

"  (  f  ^0 

-  3ri?)(T30  +  Ti2)<(T30  + 

C3T2i  To3)(T2j4To3)(3CT3o+Ti2)^-“CT2i+To3))^)  O) 

R(6)  “  (f?0  "  To3)C(T3o4  Ti2)^  -  <T2i  +  To3)^)  +  4Tn(T3o4-  ToO 

R(7)  “  3(121-  To^XTjo  f  Tj2)((T30  +  Ti2)((T30  +  Tu)^  -  3(T2t4  To3)^)“' 

(T30  -3Ti2)(T21+To3)<3CT  30+Ti2)^-(T21+To3)^)  (9) 

Tlip  functions  R(I)  ,  .  .  .  ,  R  i  1  )  can  ht  noruntized  to  moke  than  Invariant 
iinilpr  n  scalp  r.  linngp  by  substituting  the  nomnUzed  cpntral  inomenls  Qri  for  T^. 
•  Q  r  T  i  s  a  s 


w  b  p  r  P  (  p  1  q  )  ,  2  1  1 

NEURAL  NETWORK  TRAINING 

No  Hint  network  is  used  to  preforn  aspect  angle  changes  invariance  and 
give  the  output  of  ship  recongition.The  neuron  used  in  neural  network  are 
samp. The  output  of  one  iipuron  nnybe  written  as  followF[7]  t 

Q  i  -  F  (  ri  p  1  I  )  (  M  ) 

n  e  1  i  ^  W  i  j  0  j  (13) 


The  training  algorithm  for  this  neuralhelwork  may  be  written  ns  follows 
}(  H  I  1  )  WnC  n  >  kVE(  W,  j(  n  )  )  I  G(  N„  .  1  •  )  (  H  ) 

where  E  is  output  p i r  o i ,  C  is  parameter  as  I  p  n  p  e  r  a  t  u  r  e  in  Boltzmann  m  n  c  h i n  e  »  1  I 

must  be  redurpd  to  zero  slowly. N  is  normal  -  dimensional  Wipupr  process. 

SIMULATION  RESULTS 

The  proposntl  system  can  be  used  to  recognize  sliip  sllhouelles.The 
simulation  system  is  shown  In  FIG.  2. The  ship  silhouettes  ore  used  to 

recognize  are  llSnnG?|  warship  and  USSR "KAL AR  "wa r sh  ip  photos  as  shown  in  FIG. 3. 

After  system  Is  trained/ll  can  be  used  to  recognize  ship  silhouettes 
independently  of  scale  changes,  translation,  ro  lotion  orospert  angle.  FIG. 4 
shows  I  he  simiilntioii  results. 

From  FIG.4»  for  DOGSI.  when  recognizing  ship  from  tlie  side,  the  output  oI 
system  is  (0.94»0.07)j  when  recognizing  ship  from  the  top,  the  output  ol 

system  is  (11.  29,0.10),  Ihal  means  the  system  recognizes  that  ship  is  HUG. 51 
but  somelhing  little  like  "KALAR". 
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